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Abstract 

In this paper, we study the power of sequential decoding strategies for several channels with 
classical input and quantum output. In our sequential decoding strategies, the receiver loops 
through all candidate messages trying to project the received state onto a 'typical' subspace for 
the candidate message under consideration, stopping if the projection succeeds for a message, 
which is then declared as the guess of the receiver for the sent message. We show that even such 
a conceptually simple strategy can be used to achieve rates up to the mutual information for a 
single sender single receiver channel called cq-channel henceforth, as well as the standard inner 
bound for a two sender single receiver multiple access channel, called ccq-MAC in this paper. 
Our decoding scheme for the ccq-MAC uses a new kind of conditionally typical projector which 
is constructed using a geometric result about how two subspaces interact structurally. 

As the main application of our methods, we construct an encoding and decoding scheme 
achieving the Chong-Motani-Garg inner bound for a two sender two receiver interference channel 
with classical input and quantum output, called ccqq-IC henceforth. This matches the best 
known inner bound for the interference channel in the classical setting. Achieving the Chong- 
Motani-Garg inner bound, which is known to be equivalent to the Han-Kobayashi inner bound, 
answers an open question raised recently by Fawzi et al. [SFW + lf] . Our encoding scheme is 
the same as that of Chong-Motani-Garg, and our decoding scheme is sequential. 

1 Introduction 

For many classical channels, one can construct a simple sequential decoding strategy as follows: the 
receiver loops through all candidate messages trying to check if the current candidate message is 
jointly typical with the received string. If yes, the receiver stop and declares the current candidate 
message as its guess for the sent message. If no, the receiver tries the next candidate message 
and so on. If all candidate messages are exhausted, the receiver declares failure. Such a simple 
sequential decoding strategy works for example for the single sender single receiver channel as well 
as the many sender single receiver multiple access channel. 

For a quantum channel, one can ask if the sequential decoding intuition from the classical world 
leads to a valid decoding strategy. To simplify the setting, we shall restrict ourselves to channels 
with classical input and quantum output. Note that an encoding and decoding strategy for such a 
channel immediately gives us, via standard arguments, an encoding and decoding strategy for send- 
ing classical information over channels with quantum input and quantum output without any entan- 
glement assistance. For a single sender single receiver unassisted classical-quantum channel, called 
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cq-channel henceforth, Winter [Win99a] gave a sequential decoding strategy that achieves rates 
up to the mutual information. Winter's decoding strategy used a sequence of POVMs. Recently, 
Giovannetti, Lloyd and Maccone [GLM10] improved Winter's result by constructing a decoding 
strategy for the cq-channel that applies a sequence of orthogonal projections instead of a sequence 
of POVMs. Giovannetti et al.'s decoder tries to project the sent message alternately onto the typical 
subspace of the average message and the typical subspace of the current candidate message. This 
leaves us wondering if a simpler sequential decoding strategy is possible, in particular, whether just 
projecting the received state onto the typical subspace of the current candidate message is good 
enough for decoding. Besides the two sequential decoding results mentioned above, other decoders 
for the cq-channel [Hol98, SW97, HN03] use conceptually more complex strategies including in 
particular, the pretty good measurement also known as the square-root measurement [HW94 . 

In this paper, we first construct a sequential decoding scheme for the cq-channel where the 
decoder just tries to project the received state onto the typical subspace of the current candidate 
message. We show that even this simple scheme can achieve rates up to the mutual information. 
The scheme is simpler and possibly more efficient than the ones of Giovanetti et al., Winter, as 
well as other known schemes, and arguably sheds more light into the interplay between various 
typical projectors used in the decoding process. Also, our proof of correctness is clearer and 
bears a close resemblance to standard proofs of correctness of the decoder in the classical setting. 
Interestingly, our correctness proof does not use the pretty good measurement standard in many 
quantum Shannon theory papers, and may lead to more efficient decoders. 

We then construct a sequential decoder for the two sender single receiver multiple access chan- 
nel with classical input and quantum output, called ccq-MAC henceforth, achieving the standard 
inner bound for this channel. For this, we have to replace the standard conditionally typical pro- 
jectors by a new kind of conditionally typical projector approximating them. The existence of 
such suitable projectors follows from a powerful geometric fact about how two subspaces interact. 
Our sequential decoding strategy for the ccq-MAC is 'jointly typical' or 'simultaneous'. Until very 
recently, the only decoders known for the ccq-MAC were of the 'successive cancellation' variety 
(e.g. [WinOlj . Simult aneous decoders are crucial in proving many results in classical multiuser in- 
formation theory. The lack of simultaneous decoders in the quantum setting is a major stumbling 
block in the development of multiuser quantum information theory. Our simultaneous decoder for 
the ccq-MAC should be an important first step towards the development of a powerful multiuser 
quantum information theory. Another simultaneous decoder for the ccq-MAC was discovered very 
recently by Fawzi et al. [SF W + ll] . 

Finally, as the main application of our methods, we construct an encoding and decoding scheme 
achieving the Chong-Motani-Garg [CMG06] inner bound for a two sender two receiver interference 
channel with classical input and quantum output, called ccqq-IC henceforth. The Chong-Motani- 
Garg inner bound is known to be equivalent to the Han-Kobayashi [HK81] inner bound, which is the 
best known inner bound for the interference channel in the classical setting. This answers an open 
question raised recently by Fawzi et al. [SFW + ll] . The Chong-Motani-Garg and Han-Kobayashi 
inner bounds are not known to be achievable by successive cancellation. We prove the Chong- 
Motani-Garg inner bound for the ccqq-IC by analysing, as in the classical case, a special three 
sender single receiver classical-quantum multiple access channel, called CMG-MAC henceforth. 
We prove an inner bound for the CMG-MAC using our techniques which turns out to be larger 
than Chong, Motani and Garg's classical inner bound for the same encoding strategy! However, 
this improved inner bound does not enlarge the Chong-Motani-Garg region for the interference 
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channel. Our encoding scheme is the same as that of Chong-Motani-Garg, and our decoding 
scheme is sequential. 

1.1 Organisation of the paper 

We first discuss some preliminary facts in Section [2j In Section U as a demonstration of our 
basic sequential decoding approach, we demonstrate the achievability of rates up to the mutual 
information for a single sender single receiver channel. In Section HJ we construct our sequential 
simultaneous decoder for the ccq-MAC and the CMG-MAC. In Section [5] we use our inner bound 
for the CMG-MAC to prove the Chong-Motani-Garg inner bound for the ccqq-IC. We conclude 
with a brief discussion in Section 



2 Preliminaries 

2.1 Typical projectors 

Let X be a finite set. We shall overload the symbol X to also denote the Hilbert space with 
computational bases being the letters from the alphabet X. Let B be a quantum system with its 
accompanying Hilbert space denoted by B. The symbol \X\ will denote the size of the set X which 
is also the dimension of the Hilbert space X. Similarly, the symbol \B\ will denote the dimension 
of the Hilbert space B. 

Fix a probablity distribution px on X . Let X denote the corresponding random variable. The 
entropy of X is defined as H(X) := — Ylxtx Px(x) logpx(x). Let X n denote the random variable 
corresponding to n independent copies of X. For a positive integer n, the notation x n will stand 
for a sequence of length n over the alphabet X. Let N(x\x n ) denote the number of positions in the 
sequence x n containing symbol x. Let < 5 < 1. The set T^ n of frequency typical sequences of 
length n over the alphabet X for the distribution px is defined as follows: 



T s x " : = <! x n : Vx G X 



N(x\x n ) 

-Px{x, 



ri 



< px(x)5 



The above definition is the one used in e.g. El Gamal and Kim's lecture notes |GK10j . Note that 
other works often give a slightly different definition of 5-typical viz. the absolute error per symbol 
is at most 5. We shall however use the above definition for relative error 5 as it is more suitable for 
our purposes. The frequency typical set satisfies the following properties. 

Fact 1. Let < e,5 < 1/2. Define p min := mm xe x, Px (x)>oPx(x)- Let n > 2p^ m 5~ 2 log(\X\/e). 
Define c(5) := 5 log \X\ — 5 log 5. Then, 



Px-(x n ) > l-e, 



x"€T 5 xr ' 



(X)-c(S)) 



Vx n G Tp' S : 2-< H ^ +c(S V < p X n(x n ) < 2~ n{H 
|j>x™| < 2 n ( H ( x )+ c (' 5 )) 

Given a density matrix p over Hilbert space £>, consider a canonical eigenbasis S = {s\, . . . , 
of p. Consider the diagonalisation p = J2seS Qs(s)\s)(s\. Thinking of {(^(s)}^ as a probability 
distribution over S, we can analogously define the entropy of p as H(p) := — Tr [plogp] = H(qs), 
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and the frequency typical subspace of B® n corresponding to the n-fold tensor power operator p® n , 
as follows: 

N(s\s n ) 

- qs{s) 



T5 := span < s" : Vs G 5 



n 



< Sqs(s) 



Let 11^ denote the orthogonal projection onto T$ . Observe that W & commutes with p® n . The 
typical projector satisfies properties similar to those of FactQ] [Sch95, BSST02J. 

Fact 2. Let < e, 5 < 1/2. Let p be a quantum state. Define 

Qiom := qmm(p) ■= mill <?s(s). 

s&S,q s (s)>0 

Suppose that n > 2g~ 1 1 n <5 -2 log(|£>|/e). Define c(5) := <5 log |H| — 5log5. Then, 

Tr [p® n Ilf } > 1 - e, 

2 -n(H(p)+c(5)) u P n < U P" ®n < 2 -n(H(p)~c(S)) u P n 
8 — 8 i — 5 ' 

8 — 

Suppose {p x }xex is an ensemble of quantum states in B. For an input sequence x n , define 
Px n '■= Pxi <2> • • • ® p Xn ■ After reordering multiplicands, p x n, can be written as p x n = (£) xeX p® N ^ ■ 
We can then define the frequency typical conditional projector pTo l98[ ISW971 Win99b] n^ n as 

n£* n : = (g) nf 

x&X 

Let i7(.B|X) denote the conditional Shannon entropy of the quantum system B given random vari- 
able X i.e. H(B\X) := YlxeX Px(x)H(p x ). Note that n^' 1 commutes with p x ™. The conditionally 
typical projector satisfies properties similar to Fact [5] if the input x n is typical. 

Fact 3. Let < e,5 < 1/2. Suppose X is a classical random variable and p XB is a classical- 
quantum state. Define 

p min := min Px(%), Qmin ■= min qram(Px)- 

xGX,p x (x)>0 x&X,p x (x)>0 

Let n > A5- 2 p^ in q m l n log(\B\\X\/e). Let x n G Tf". Define c{5) := 5log \B\\X\ - <51og<5. Then, 

Tr [ Px nIL p s * n ] > 1-e, 
2 ~n(H{B\x)+c(6)) U P x n < U p ^ n p x n <2- n ^ B ^- c( -^Up x n 5 , 

rjy yrp x n < 2 n(H(B\X)+c(S)) 

Define the average state of the ensemble p := YlxeX Px(x)p x . The following nontrivial fact that 
the typical projector corresponding to the average state p® n actually captures most of the mass of 
p x n if x n is typical was proved by Winter [Win99aj . We will require a slightly stronger statement 
for our purposes which we now state. 
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Fact 4. Let < e, 5 < 1/2. Suppose X, Y are classical random variables and p XYB is a classical- 
classical- quantum state. Define 

Pmin := mill PXY(x,y), Qmin ■= min qmin(Pxy)- 

(x,y)e(Xxy),p XY (x,y)>0 (x,y)e(Xxy),p XY (x,y)>0 

Let n > 45- 2 p^ n q-llog(\B\\X\/e). Let x n y n E zf^". Then, 

> 1 - e, Tr [p^yull^f] > 1 - e. 

A point to note about the above facts on typical subspaces is that they are all proved using 
Chernoff bounds instead of Chebyshev bounds or law of large numbers as is sometimes done in the 
literature. This is done for reasons of efficiency viz. to ensure that the concentration of measure e is 
exponentially small in the number of copies n. This exponential dependence is not very important 
however, and we could have used weaker concentration results for our purposes. Note also that in 
all cases above, c(5) —> and 5~ 2 c{5) — > oo as 5 — > 0. 

Notation: Finally, we fix some notation for entropic quantities that will be used throughout the 
paper. Suppose ABC is a quantum (which also subsumes classical) system with joint density matrix 
pABC en t r0 py of, for example, subsystem AB under joint density matrix p ABC is denoted 

by H{AB) p := H(p AB ), where p AB is the marginal density matrix of subsystem AB. Sometimes 
when the underlying state p is clear from the context, we drop it in the subscript. The conditional 
entropy, for example, of system C given system AB is denoted by H(C\AB) p := H(ABC) — H(AB). 
Now suppose for example that B is classical, that is, the joint density matrix looks like p ABC = 
Pr[&]|6)(6| (g) p AC , where \b) ranges over the computational basis of Hilbert space B of system 
B, {Pi[b]}b form a probability distribution over the computational basis of B, and {p AC }b are joint 
density matrices of system AC. We will interpret p AC to be the joint density matrix of system AC 
when system B is in the computational basis state \b), which occurs with probability Pr[6]. If B is 
classical, H(C\AB) P = J2 b Fv i b } H ( c \ A ) AC ■ We sha11 define H(C\A,B = b) := H(C\A) ac. The 
mutual information between, for example, A and BC is defined as L(A : BC) P := H{A) + H{BC) — 
H(ABC). The mutual information of A and C conditioned on B is defined as L(A : C\B) p := 
H(A\B) + H{C\B) - H(AC\B) = H(AB) + H(CB) — H(ABC) — H(B). If B is classical, it is equal 
to L(A : C\B) p = £ b Pr[6]/(,4 : C) p A C . We shall define L(A : C\B = b) := L(A : C) pA c 

2.2 Asymptotic smoothing 

We can now use the facts about typical subspaces from Section [2TT1 to prove the following asymptotic 
smoothing lemma. It will be applied in the analysis of the decoding error probabilities of all our 
decoders henceforth. Some of these applications can do with less general versions of the lemma, 
and it is indeed possible to prove such versions with slightly better parameters. But since they do 
not lead to significantly lower decoding error probabilities, we stick to the following general version. 

Lemma 1. Let XZYB be a classical- classical- classical- quantum system with joint density matrix 
pXZYB = ^ px(x)p z \x{z\x)PY(y)\x,z,y}(x,z,y\ <g> p xzy . 

(x,z,y)£XxZxy 



Tr 



p x n y nll 2S 
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Define pX n ^Y-B" ._ {p xzY B) ®n_ Let Q < e 8 < 1/64 ^ 

Pmin := , s min ^Py (y), 

(i,z,!;)eA'x2xy,pj fz (3:,2)py(!/)>0 

(/min ' = mill Qmin(Pxzy ) ■ 

(i,z,y)EA'x2xJ,p xz (a;,2)j)y(!;)>0 

Lei n > 45- 2 P ^ n q m } n log(\B\\X\\Z\\y\/e). Define c{5) := 5log\B\\X\\Z\\y\ -5 log*. T/ien tfiere is 
an ensemble of density matrices {p'^ z ™yn.}(x n ,z n ,y n )ex n xz n y.y n such that for 

lX n Z n Y n B n \ „ / n\„ / ni n\„ / n\\n n n\ i n n ni „ lB n 

P ■= 2^ Px™(z )pz«|x«(^ F )PY»{y )\x ,z ,y ){x ,z ,y \®p x n z n yn , 

(x n ,z n ,y")eX"xZ"xy n 

and 

jB n _ f n ,n\JB n iB n _ ( v n\-n\jB n iB n „ ( n .n\JB n 

Px™z™ ■- 2^ PY n KV )Px™z™y"i Px" ■- 2^ PZ"\X"{ Z \ x )Px™z™> P ■= } , PX«{X )P x n , 

y n ey n z n ez n x n ex n 

we have 

Vx n z n E T { 5 XZr : ||P^IL ^ 4-2-"W B l^- c ( 65 ), 

\/x n £TF: Wo'TW < A-2-< H{ - B \ x ^- c ^ 

o 1 1 Woo — ' 



p' 



w„n y n,,n p T (XZY) n , m , B n _ B n II < 11 r 

" z y t ^5 • ||Px- n z"j/ n Px n 2 n j/"||i — ■ L - L V fc ) 

||^/X n Z n y ,I _B n _ pX n Z n Y n B n || < 13y^ 

Proof. For x n S <Y ra and z ra E -Z n , define 

Pi"z" '■= PY n (y n )Px"z n y n , Px n '■= Pz^X"^^™)/^"^- 

yrifzyn z n €Z n 

Recall that Ei^^P^^lfr" = P® n > wnere P := P B - Let H x n z n denote the conditionally typical 
projector ilgl™ 2 " , H x n denote the conditionally typical projector IIg| n and II denote the typical 

o n (XZY) n 
projector II^ . For x n z n y n 6T! , define 

j llll^n IT^n z n Px n z n y n H;p n YY x n II 

n z n Px n z n y n Hx n ^ n Hx n n] 

From Facts 0] and [5l we get 

Tr [llll^n 11^;" z n Px n z n y n Ha: n z n H;r n H] 

> Tr [Ilp^n^nynll] — \\p x n Z n y n ~ ^X n Px n Z n 'y n ^-X n \\ I 

— 1 1 II<E n Px n z n y n Ha; 71 — ^-x n z n Px n z n y n ^-x n z n ^-x n || 1 

> TV [Ilp^n^nynll] — HPa^"^ — Ii x n Px n z n y n ^-x n \\ i ~ \\Px n z n y n ~ ^-x n z n Px n z n y n n x n z n 1 1 1 

> l-e-2^e-2Ve > 1 - 5\/i, 



OG 
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and 

\\Px n z n y n ~ Px n z n y n \\i 

< \\p x n z"y n — Tlll x nll x n z np x n z nyrill x n z nll :!l .nll\\ 1 + 1 1 lHI x n H x n z n p x n z n y n H x n z n II x n II — p'x™z n y n \\ 

< \\P 

x n z nyn T[p x n z TlynTl\ | -y + lln/Jajn^n^nll im^n Tl x n Z n p x ™z n y n H x n z n H x n II \ \ j 

+ 1 - Tr [nn x nn x 

n z n Px n z n y n 

n n^n] 

< \\p x n z n y n — II/5 x n j/i II 1 1 x + \\p x n Z n y n ~ ^X n ^-X n Z n Px n Z n y n ^X n Z n ^-X n \\ I 

-\- 1 — Tr [ini^n ri^fi z n p x n z n y n z n n^ ,ri n ] 

< \\Px n z n y n — ^Px n z n y n ^-\\i + \\Px n z n y n ~ ^-x n Px n z n y n ^-x n \\i + 

\\n x n p x n z nynTl x n — Tl x nYl x n z n p x n z nynYl x n z n 

Hx»\\i + 1 - Tr [nix^n x n z n p x n z n y n ^^-X n Z n ^^X n HJ 

< \\Px n z n y n ~ '^-Px n z n y n '^\\i + ||Ar n z n j/ n — ^-x n Px n z n y n ^-x n \\ i + 

\\p x n z n yn — Ii x n Z n Px n Z n y n ^-X n Z n \\-l H~ 1 [nilj n IT ^ n z n p x n z n yU Yl x n. z n 

< 2^ + 2^ + 2^ + 5^ = Uy/e. 

For x n z n y n j^ xzy ) ? define p' x „ z n yn := ^Jpr. We now define 



Then, 



I fX n Z n y r ' n B n X n Z n Y n Q n II 
\p p 111 



= E P(XZ)"(x n Z n )p Y n(y n )\\p' x n z n yn - Pxn^yn^ 

(x n ,z n ,y n )eX n xZ n xy n 
< E P(XZ)"(x n Z n )PY"(y n ) \\p' x "z"y" ~ Px n z n y n \\ x + 



(x n ,z n ,y n )£T ( s XZY)n 



2 E P(xzr(x n z n )p Y «(y r 

{x n ,z n ,y n )$_T ( s XZY)n 

< llVe + 2e < 13-v/e, 



where we used Fact [TJ 

For x n z n G T$ X , we have 



on r-^ IIII x nri :r n 2 n/3 x n z n^nII :r n z nn x nII 

/°x"z» = E p Y ™{y n ) „ rrrTT *-^= fj— FFT + 

E ^"(y n )i 1 



y n :x n z n y n ^T^ XZY ^ 

< (i — 5\fe) 1 py»('/'')nn 3 ;«n 3 ;n 2 -ip ll n 2 n !/ nn I n 2 -in I »n + — 

y n :x"z n y n £T^ ' 

< (l — 5y/e) l TiTl x nIlx n z n j E PY n (y n )Px n z n y n J n^znElcnll + 



.fey" 



(i - 5^y l uu x nU x 



|f?|« 

1 



< (i - 5Ve)~ 1 2- n W B i xz 5"- c ^ira a «n <B n*»ii a nn + 



where we used Facts S] and El This shows that 



P. 



'T z n\\ < (1 - Bv^-^-^^l-*^' -0 ^ + |£|~ n < 4 • 2-™( H ( B l xz )p- c ( 65 )), 



since e < 1/64. 

Similarly for x n 6 Tj^ , we have 



= E p^c^vj 



< 



< (l-S^)- 1 £ PZ<Z n \x n )UU x np xnz nU x nU+ 

= (1 - b^e^TlTixn p x n,U x nTl + " 



1*1" 

< (i-5^)- 1 2- n ^ B i x )"- c ( 65 ))nn :c nn+ " 



|jB| n ' 

where we used the fact that II x n 2 n and /9 x n z n commute. This shows that 

||p^™|| < (1 - 5 v / i)~ 1 2~ n(H(B|X) ' 3 ~ c(6<S)) + |i3|~" < 4 • 2-"( I ( JJ l x ^ c ( 6S )), 



since e < 1/64. 
Finally, 



P ' Bn = E p^(*vjr 

E px*^") ((i - Bv^nrw^n^n + j 

•n c Vn V 11/ 

1 



< 



= (l-5V~ey 1 Up m U+ " 



\B\ n 

1 



< (i- 5 ^)- 1 2- n ^ B )^ c ( 25 ))n + 



\B\ n ' 

where we used the fact that H x n and p x n commute. This shows that 

\\p' Bn \\ < (1 - 5^)-i2~ n(H(B) "~ c(2<5)) + \B\~ n < 4 • 2- n ( H ( B )"- c ( 25 )), 
since e < 1/64. The proof is complete. 



2.3 Geometric properties about projectors 

We first recall the following 'gentle measurement' lemma of Winter |Win99aj ION 07]. The lemma 
is typically used to assert that if a quantum state has a high probability of succeeding on a mea- 
surement outcome, then the collapsed state after the outcome has occured is close to the original 
state. 

Fact 5. Let M be a positive operator such that M < 1. Let < e < 1. Let p be a density matrix. 
Suppose Tr [MpM] > 1 - e. Then, \\p - MpM^ < 2y/e. 

The following geometric property is crucial to our construction of a decoding strategy consisting 
of a sequence of orthogonal projectors. It says that if we apply a sequence of orthogonal projectors 
to a pure state such that \tp) has a large projection onto each projector, then the vector 
obtained at the end of the sequence is close to the original vector The advantage with respect 
to Winter's 'gentle measurement' lemma (Fact [5]) is that in the gentle measurement lemma square 
roots of the error probabilities under the operations add up, whereas in our lemma we exploit the 
fact that each operation is an orthogonal projection to obtain that the error probabilities add up. 
The disadvantage of our lemma with respect to the gentle measurement lemma is that our lemma 
guarantees closesness of the final state to the initial state only for pure states. Nevertheless, we 
shall see by its corollary Lemma [3] below that our lemma can still be used to lower bound the 
success probability of a sequence of orthogonal projectors applied to a mixed initial state. Our 
lemma allows us to avoid dependencies between the decoding operations that were there in earlier 
sequential decoding strategies e.g. in Winter's strategy [Win99aJ. It allows us to lower bound the 
decoding success probability in a manner very similar to the classical setting. 

Lemma 2. Let v be a vector in a Hilbert space and 11^,..., Ill be orthogonal projectors. Let 
Ilj := 1 — II- be the projectors onto the orthogonal subspaces. Then, 

k 

\\v-w k ---w 1 v\\ 2 2 <Y,\\^v\\l 

i=l 

Proof. We prove this by induction on k. The null base case corresponding to k = is trivial. For 
the induction step, suppose 

Then, 

|h- n fc n 'fc-l--- n Hl2 = |l U_n fc"|l2 + ll n fe" _n * n fe-l''' n/ l U ll2 

< \\U k v\\ 2 2 + \\v-IL' k _ 1 ---U' 1 v\\l 

k 
i=l 

The equality above uses the fact that the vector (v — n^u) is orthogonal to the support of n' fc 
since IT^ is an orthogonal projector. In particular, (v — Illu) is orthogonal to the vector (Tl'uV — 
IIlIIl]^ • • • II^u). The first inequality above follows from the fact that an orthogonal projector like 
n^, cannot increase the length of a vector. The proof is complete. □ 



k-l 

■■■ U 'l v \\l <EH n ^ 

i=l 
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We can now prove the following corollary of Lemma [2j This lemma is what we actually use in 
the error analysis of the sequential decoder. 

Lemma 3. Let p be a positive operator on a Hilbert space and Tr p < 1. Using the notation of 
Lemma\R 



Tr[n' fc ---n / 1 pn / 1 ---n' fc ]>Tr P -2, 



, ^Tr[pIL,]. 
\ »=i 



Proof. By expressing p in its eigenbasis and using the concavity of the square root function, we can 
assume without loss of generality for the purpose of this proof that p has rank one i.e. p = \v){v\ 
for some vector v, \\v\\ 2 < 1. That is, we just have to show 



\n' k ..-u[v\\ 2 2 > Ml -2, 



^' |n 



1<J\\2- 



By Lemma [21 



\ i=i 



> v 



l n fc-- -n'lulL , 



leading to 



i=l 



> H2-2. 



\ i=l 



This completes the proof. 



□ 



Lemma [3] suggests the following natural sequential decoding paradigm for a channel. Let 
III, . . . , Iljfc, . . . be orthogonal projectors. Intuitively, if the ith message were sent, the output state 
Pi of the channel would have a large projection onto IT i.e. Tr HiPi ~ 1. Supppose now that the 
&th message is sent resulting in output state pk of the channel. The decoder tries to project pk 
onto IIi. If he fails, he then tries to project the collapsed state onto II2. The decoder continues in 
this fashion. If he succeeds in projecting onto IT for some i, he declares i to be his guess for the 
sent message. If he fails to project onto any IT, he declares failure. Using Lemma El we can upper 
bound the decoding error probability err(fe) of this strategy by 



err(k) < 2 A 



fe-l 



^2Tr[p k Hi] + l-Tr[p k Il k 



Our quantum sequential decoding paradigm is very analogous to the natural classical sequential 
decoding paradigm, and gives low decoding error probability for any set of messages {1,2,...} 



10 



with channel output states {pi,p2, • • •} if we can find, for example, a set of decoding orthogonal 
projectors {IIi, II2, . . .} with the property that for each k, Tr [pjfellfc] ~ 1 and Yli-.i^k ^ r [Pfc^*] ~ 0- 
In contrast, the sequential decoding approach of Winter [Win99aJ requires extra conditions on the 
decoding projectors that involve requiring a sequential ordering of the messages, which leads to 
difficulties in applying it to channels with multiple independent senders. The sequential decoding 
approach of Giovannetti, Lloyd and Macconc [GLM10] is heavily tied to the setting of the cq-channel 
and requires independent choice of codewords for different messages in the error analysis, which 
again leads to problems in applying it to channels with multiple independent senders. Moreover, 
they also need to use the projector onto the typical subspace of the average channel state is also 
required besides the conditionally typical projectors for each message. 

Note that a similar upper bound on the decoding error probability can be obtained for a decoder 
using a pretty-good-measurement (PGM) strategy, also known as the square-root measurement 
strategy. Consider the PGM defined by the orthogonal projectors IIi, . . . , Iljfc, . . . as follows: 

£:=^IL, T 4 := S-^ILE- 1 / 2 , 

i 

where E -1 / 2 is defined in the natural fashion on the support of £ and zero on the orthogonal 
complement. Suppose the A;th message is sent. The probability err'(fc) of wrongly decoding the 
message is Tr [(1 — T k )pk\, which by the Hayashi-Nagaoka inequality [HN03J is upper bounded by 

err'(fc) < 2(1 - Tr [p k IL k ]) + 4 Tr [p k Ih}. 

In this sense, the sequential decoding strategy suggested by Lemma [3] cannot give anything funda- 
mentally different from known decoder construction techniques. The advantage of our sequential 
approach is that it gives a potentially more efficient decoder than the pretty good measurement. 
Also, the sequential decoding strategy is closer to the natural classical intuition and arguably sheds 
more light on the interaction between the various projectors Ilj in the decoding process. 

In order to construct a simultaneous sequential decoder for the cq-MAC, we will need the 
following geometric fact about how a pair of subspaces interact. This fact lies at the heart of 
several beautiful results in quantum complexity theory SzeO 1 . M WO 5 1 Wat09j. 

Fact 6. Let A, B be subspaces of a Hilbert space %. Then there is a decomposition of % as an 
orthogonal direct sum of the following types of spaces: 

1. One dimensional spaces orthogonal to both A and B, 

2. One dimensional spaces contained in both A and B, 

3. One dimensional spaces contained in A but not in B, 
4- One dimensional spaces contained in B but not in A, 

5. Two dimensional spaces intersecting A, B each in one dimensional spaces. 

Moreover, the one dimensional spaces in (2) and (3) above and the one dimensional intersections 
with A of the two dimensional spaces in (5) above form an orthonormal basis of A. A similar 
statement holds for B. 
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Using Fact we can prove the following lemma. This lemma will be useful in designing a 
sequential simultaneous decoder for a ccq-MAC. 

Lemma 4. Let A', B' be subspaces of a Hilbert space T~L. Let IL4/, Hb 1 denote the orthogonal 
projectors onto A' , B' . Let < e < 1. Then there exists a (possibly null) subspace A of A' 
such that for all vectors v E A, || n^'^ II2 — (1 ~~ V^D IMI2 • Let B be the (possibly null) subspace 
of B' spanned by the vectors Hb' v > v S A. Let Ub be the orthogonal projector onto B. Then, 
lie < (1 — ^)^ 1 Hb'^a , ^b i ■ Suppose furthermore there is a positive matrix p, Tr p < 1 with 
support in A' such that Tr [pll^/] > 1 — e. Then A is a non-null subspace and Tr [pile] > 1 — 2-^/e. 

Proof. Take the orthogonal direct sum decomposition of % with respect to the subspaces A', B' 
promised by FactO Consider the basis {|a')} a ' of A' given by Fact [6l The important thing about 
this basis is that the vectors Ub'W) are orthogonal (some of them could be zero). Let {|o)} a range 
over the subset of these basis vectors satisfying the property that ||nB/|a)|| 2 > 1 — -y/e. Define A to 
be the subspace spanned by these basis vectors. Note that A could be the null space if there are 
no such basis vectors. Since the vectors TlB>\a) are orthogonal, we have that for any vector v £ A, 
1 1 IT ^/ ^ 1 1 2 — (1 — V^D IMI2 ■ Observe that B is spanned by the non-zero orthogonal vectors n#/|a}. 
It is now easy to see that 

n B < (1 - ^~e)- l n B ^A^B> < (1 - v^r^n^n^. 

Suppose now we have a positive matrix p with the desired properties. Let p = Yli Qi\ a i) { a i\ 
be a diagonalisation of p into its eigenbasis. Therefore Tr [/9IL3/] can be described by the success 
probability of the following random process: 

1. With probability 1 — Tr p, abort; 

2. Choose \ai) with probability 

3. Choose \a') with probability |(a'|aj)| 2 ; 

4. Try to project |a') onto B', this succeeds with probability ||nB'|a') \\^. 

Since Tr [pile'] > 1 — e, with probability at least 1 — y/e over steps (1), (2) and (3), we get a 
basis vector \a!) such that ||IL3'|a')ll2 > 1 — \fe. Thus, with probability at least 1 — yfk over steps 
(1), (2) and (3), we get a basis vector of subspace A. In particular, A is a non-null subspace and 
Tr [pU A ] > 1 - y/e, which in turn implies that Tr [pU B ] > (1 - y/e) 2 > 1 - □ 

3 Sequential decoding for single sender single receiver channel 

Let : x 1 — y p% be a channel which takes a classical input x and outputs a quantum state p x . We 
use p XB := ^2 xe x Px(x)\x)(x\ <S> p x to denote the joint state of the system XB. We will now show 
how to transmit classical information over £ at any rate R strictly less than the mutual information 
I{X:B) p . 

Define p := Ylxex Px(x)p x to be the average density matrix of the output system B. Let 
< e,5 < 1/64. Define p min := mm xeXtPx ( x ) >0 p x (x), q min := mm xeXtPx ^ >0 q min (p x ). Let 
n > A5~ 2 p^ m q-l n log(\B\\X\/e). Define c(5) := 6log\B\\X\ - Slog 5. For x n £ jf let U x n denote 
the conditionally typical projector . For x" Tg , define IT^n := 0. Suppose the sender wants 
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to transmit at rate R using n independent uses of the channel £. Let his messages be denoted by 
m, 1 < m < 2 nR . The sender uses the random encoding strategy of Figure [U to choose a codebook 
C. 

Encoding strategy to create a codebook C 



For m = 1 to 2 , choose x n (m) ~ X n independently. 



Figure 1: Encoding strategy for the cq-channel. 

For the codebook C, the receiver uses the sequential decoding strategy of Figure [2j As will 
become clear later, the ordering of messages is not very important but we impose the normal 
ordering while describing the decoding algorithm for clarity of exposition. An interesting feature 
about our decoder is that it only uses projectors onto conditionally typical subspaces of candidate 
messages. In particular, it does not use any projection onto the typical subspace of the average 
message, unlike Giovannetti, Lloyd and Maccone's sequential decoder [GLM10J and many other 
decoders for the cq-channel described earlier in the literature. The only other example of a decoder 
for the cq-channel that solely uses projectors onto conditionally typical subspaces of candidate 
messages that we are aware of is a pretty good measurement based decoder of Wilde [Willi} 
Exercises 15.5.4 and 19.3.5]. 

Decoding strategy for codebook C 



• Received some state r at the channel output; 

• For m = 1 to 2 nR , repeat the following till first success; 

- Let T m be the state at the beginning of loop number m\ 

— Project r m onto U x n( m y If fail proceed to next iteration (note that the state 
changes), else declare success and announce m to be the guess for the sent 
message. 

• If all candidate messages are exhausted without success, abort. 



Figure 2: Decoding strategy for the cq-channel. 

In order to analyse the success probability of decoding a message correctly, we first imagine 
that we are given a slightly different channel working on alphabet X n with output Hilbert space 
B® n . It is defined as <£' : x n t- > p' x n where the states {p^ }x n ex n ar e as provided by Lemma[T]given 
state p XB . Define the averaged density matrix p' := Ylx n ex n Px n (x n )p x n. Let p' xnBn be as defined 
by Lemma [TJ The encoding and decoding strategies used continue to be exactly as in Figures [1] 
and [21 even though the channel we are now working with is a single copy of <£'. 

For 1 < m < 2 nR , define tl xn ^ := 1 — IL^i^) to be the orthogonal projector corresponding 
to failing to project onto H x n( m y The success probability of decoding message m correctly for a 
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single copy of channel £! is 

By Lemma O it is lower bounded by 



1 - 2„ 



171 — 1 



> 1 " 2 / ^ Tr [n x n (i) ^. n(m) ] + 1 - Tr [n x „ (m) // n(m) ]. 

Intuitively, the last message has the largest decoding error. 

We shall use the symbol E [•] to denote expectation over the choice of the random codebook 
C. We shall also use notation like E^jjOxi] to denote Y2x n ex n Px n (x n )Px n - The expected error 
probability E [err(m)] of decoding message m is now at most 

E [err(m)] 



< 2 • E / £ Tr [U xHl) p' xn(m) ] + 1 - Tr [n^ (m) ^ n(m) ] 

< 2 / J2 [E ln xn(l)P > }] + 1 - E [Tr [U xHm)f / )] 



2J{2 nR - l)Tr [{B x n[U x n])(B xn [p' xn })} + 1 - E x n[Tr [IW^]] 



< 2^2 nR • E x n[Tr [n x n P '}} + 1 - E x n[Tr [IW 2 „]]. 

The second inequality follows from concavity of square root. The equality follows from the inde- 
pendent and identical choice of codewords for a pair of different messages. 
We now bound the terms on the right hand side above. For x n 6 , 



Tr [U x np'] < Wp'W^ ■ rank(II ;r n) 

< 4 . 2 -«(^(B)p-c(25)) . 2 n(H(B\X) p +c(S)) 

< 4 . 2 -n(/(X:B) p -2c(25)) 



(1) 



where we use Fact Eland Lemma [U If x n Tf n , n x n = and the upper bound on the trace above 
holds trivially. Again, for x n 6 T^", 

Tr [n x n^ n ] > Tr - ((^n - > (1 - e) - lly^ > 1 - 12 Vi, (2) 

where we used Fact [3] and Lemma [TJ This implies that 

E x n[Tr \n x np' xn }} > (1 - e )(l - 12^) > 1 - 13^, 

by Fact [TJ Putting all this together, we get 



E [err(m)] < 2^2"^ • 4 • 2~ n ^ x -- B )p- 2 < 2S )) + 13^- 
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Choosing a rate R = I(X : B) p - 4c(2<5) gives us E [err(m)] < 8e x / 4 + 4 • 2~ ncl - 2& \ for which if we 
take n = Clog(l/e)<5~ 2 for a constant C depending only on the state p XB , we get E [err(m)] < 

ggl/4 + 4 . 2 -C<5- 2 c(25)log(lA) > 

Since we have shown that E [err(m)] is small for all messages m, the expected average error 
probability E [effgy] := E [2~ nR Ylm err C'( m )] f° r channel £' is also small. We now indicate why the 
same is true for n copies of the original channel £ using the same encoding and decoding procedures 
described in Figures Q] and [2j 

Let m range over messages in [2 nR ]. Fix a codebook C. Let P c denote the POVM corresponding 
to the decoding process for codebook C with POVM elements T>%. Define := 1 — V^. Let 
(x n ) c (m) denote the codeword for message m under C. The average error probability of decoding 
under C for channels £, £' is given by 

err<? = 2~ nR ^ Tr [^ (lf(m) ], 
m 

erf?, = 2-^^Tr[^ n)C(m)] . 

m 

As before we use the symbol E [•] to denote expectation over the choice of the random codebook 
C, and symbols like E x n yn [-] to denote ~^2 x n y n Px n (x n )PY n (y n ){-)- The difference between the 
expected average error probability of decoding for channels £, <£ is given by 

|E[eff£] -E[err£,]| 
= E 



< E 

< E 

= 2~ 



2-^^Tr [V%p {xn) c im) ] - Tr [V%p{ xn)C (m) ] 

m 

2 nR y^ |Tr [V mP(x n ) c (m)] ~ Tr PmP(i»)0( m )] 

m 

1 1^ \\P(x") c (m) ~ P( x n)C {m ) 
m 



P(x n ) c {m) P(x") c (m) 



— 2 UR E x n [\\p x n 

m 

< 13ye. 



Pi 71 



X n B n 



pfX n B n || 



The last equality follows from the definitions of p xnB " and p' xnB " . The last inequality follows 
from Lemma [TJ 

We have thus shown that with the encoding and decoding procedures of Figures Q] and [2j 
choosing a rate R = I(X : B) p — 4c(2<5) gives, for n copies of the channel £, an expected average 
error probability of at most 



E [erf?] < 8e 1/4 + 4-2" 



-C6- 2 c(28) log(l/e) 



+ 13^^ 21e 1/4 + 4-2 



-C5~ 2 c(2S) log(l/e) 



where C is the same constant as above, depending only on the channel £. This quantity can be 
made arbitrarily small by choosing e and S appropriately. We can also simultaneously make c{28) 
arbitrarily small so that any rate R strictly less than I(X : B) p can be achieved. We have thus 
shown the following theorem. 
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Theorem 1. For a single sender single receiver channel £ with classical input and quantum output, 
the random encoding and sequential decoding strategies described in Figures and can achieve 
any rate strictly less than the mutual information with arbitrary small expected average probability 
of error in the asymptotic limit of many independent uses of the channel. 

A proof without using asymptotic smoothing: It is possible to construct slightly more 
complicated sequential decoders and improve the upper bound on the decoding error probability 
that we can prove. For example, the decoder can first try to project the received state onto the 
typical projector II := LT^ . If the attempt fails, then the decoder aborts. If the attempt succeeds, 
then the decoder tries projecting onto U x n^ m ^ for m = 1, . . . , 2 nR as in Figure [2J A very similar 
proof as above, using Lemma[3]with p = Hp x n( m }U, shows that the expected average decoding error 
probability is small. This proof does not use asymptotic smoothing i.e. Lemma HJ However, the 
resulting upper bound on the error probability that we can prove is not significantly better than 
the upper bound we prove above. In the interest of keeping the decoder construction as simple as 
possible, we have provided the proof above. 

4 Jointly typical decoding for a multiple access channel 
4.1 Two sender MAC 

Let £ : (x, y) h-> p xy be a channel that takes two classical inputs x and y and outputs a quantum 
state p xy in Hilbert space B. We use 

p XYB ._ Px (x)p Y (y)\x,y)(x,y\ <g> p xy (3) 

(x, y )eXxy 

to denote the joint state of the system XYB. We will show how to achieve the following standard 
inner bound for this ccq-MAC using a jointly typical decoder performing a sequence of orthogonal 
projections. 

R 1 < I(X : B\Y) P , R 2 < I(Y : B\X) p , R 1 +R 2 < I(XY : B) p . (4) 
Define the following averaged density matrices: 

Px ■=^2pY{y)pxy, Py ■= ^ Px{x)p X y, p 1= PY (v) Py ■ 

y ey x&x y ey 

We can now define the n-fold tensor product matrices p x ™y n , Px n , Py™ f° r sequences x n , y n in the 
natural manner. The following equations follow easily. 

Vx™ G X n : p x n = ^2 PY n (y n )Px™ y ™, 
y n ey n 

yy n ey n :p y n = PX™(x n )p x n y n, 

x n ex n 

P = ^ PX n (x n )p x n 

x n ex n 

= ^2 Py n (y n )Py n = XT Px™(x n )pY«(y n )px"y™- 

y n &y n (x n ,y n )£X n xy™ 
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Let < e,5 < 1/64. Define 



Pmin := , min Px(x)py(v), 

{x,y)<=Xxy,px(x)p Y (y)>0 

<7min := min qmia(Px,y)- 

(x,y)<=Xxy,px(x)p Y (y)>0 

Let n> ^p^g^ log(|iB||^||y|/e). Define c(5) := 5\og\B\\X\\y\-5log5. Suppose that x n y n G 
Tg . Note that this implies that x n G Tg and y n G T/ ; however, the converse is not true. 
Let U x n y n, IL x n, U y n denote the conditionally typical projectors Hg xnyn , IIg| n , I4g| n . We define a 
projector H x n y n as follows. Treat the supports of the conditionally typical projectors H x n y n, U y n as 
the subspaces A' , B' of LemmalU and obtain Ti x n y n as the projector n# promised by Lemma[H If 
x n y n g , define H x n y n ■= 0. The decoding procedure shall use the projectors TL x n y ™ instead 

of the conditionally typical projectors H x n y n one might naively expect. 

Suppose senders 1, 2 want to transmit at rates i?2 using n independent uses of the channel 
(£. Let their messages be denoted by m\, rri2 respectively, where 1 < mi < 2 nRi . The senders use 
the random encoding strategy of Figure [3] to choose a codebook C. 

Encoding strategy to create a codebook C 
Sender 1: For m\ = 1 to 2 nRl , choose x n {m\) ~ X n independently. 
Sender 2: For 771,2 = 1 to 2 nR2 , choose y n (rri2) ~ Y n independently. 



Figure 3: Encoding strategy for ccq-MAC. 

For the codebook C, the receiver uses the sequential decoding strategy of Figure [H As will 
become clear later, the ordering of messages is not very important but we impose the lexicographic 
ordering looping over 7712 first and mi later, while describing the decoding algorithm, for clarity of 
exposition. 

In order to analyse the success probability of decoding a message correctly, we first imagine that 
we are given a slightly different channel €! working on alphabets X n , y n with output Hilbert space 
B® n . It is defined as £' : (x n ,y n ) 1— > p x n y n where the states {p^^n}( provided 
by Lemma Q] given state p XYB . Define the following averaged density matrices: 

Px" : = ^2 PY n (y n )Px"y™, Py" '■= ^2 PX n (x n )p' x n y n, p'\= ^ PY"(y n )p'y»- 
y n &y n x n £X n y n &y n 

Let p' xnY " Bn be as defined by Lemma [TJ The encoding and decoding strategies used continue to 
be exactly as in Figures [3] and 01 even though the channel we are now working with is a single copy 
of 

For (mi, 777 2 ) G [2 nKl ] x [2 nR2 ], define 

^x n {m\)y n (m2) • ^ ^x n (mi)y n (1TI2) 
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Decoding strategy for codebook C 



Received some state t b " at the channel output; 

For mi = 1 to 2 nRl , 

For m 2 = 1 to 2 nR2 , 

Repeat the following till first success; 

— Let r mim2 be the state at the beginning of loop number (mi, 7712); 

— Project T mim2 onto IL x nr mi \ y nr m2 y If fail proceed, else declare success 
and announce (mi, 7712) to be the guess for the sent message pair. 

If all candidate message pairs are exhausted without success, abort. 



Figure 4: Decoding strategy for ccq-MAC. 



to be the orthogonal projector corresponding to failing to project onto il x n (mi)y n (m>i) ■ Let --(mi, 1712) 
denote the predecessor of (7111,1112) in the lexicographic order if it exists. We shall use the notation 
(x n , y n )(--(mi, 777,2)) to denote (x n (m' l ),y n (m' 2 )) where [m! x ,m! 2 ) :=--(mi,m2). 

The success probability of decoding (7711,7712) correctly for a single copy of channel £' is 

n x n(l)yn(l) • • • ^(x n ,y 7l )(—(mi,m 2 ))'^-X n (m 1 )y n (m2)]- 

By Lemma O it is lower bounded by 



1 - 2 • 



-(mi,m 2 ) 



Tr Px"(%™(j)/^n( mi)y n( m2 )] +Tr [Rx n (m 1 )y n (m 2 )P' x ri(m 1 )yn(rn2)\ 



> 1 - 

2 • 



^ Tr [^x"(i)y«(j)P' x n^ mi ) y u^ m2 )] + 1 Tr [^ x ^( mi )y n (m 2 )P x n^ m ^ y n^ m ^] ' 

\ (id): 

We shall use the symbol E [•] to denote expectation over the choice of the random codebook C. 
We shall also use notation like E x n y n [p x n y n] := Ylx n y « Px n (x n )PY n (y n )p x n y n i an d E y n[p' x n y n] := 
J2 y n PY n {y n )p'x n y n - The expected error probability E [err(mi, m 2 )] of decoding (mi, 777,2) is now at 
most 

E [err (mi, 7712)] 



< 2 - E 



i 



TV [U x n (i)y n U)P ' xn 



(mi)y™ (m 2 ) 



] + 1 - Tr [n a .n( mi )j / n( m2 )P a . Tl ^ mi: j 1/n 



(m 2 y 
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< 2 



( ^ Tr [E \^-x"(i)y n {m2)P , x^{rm)y n (m 2 )W + Tr [ E ^ n (mi)y n (j)P'x n (m 1 )y n (m 2 )\'\ + \ 

7j Tr [E [fiajn^j/n^P^n^^yn^)]] + 1 — E [Tr [fi^ ■(™i)V n -(ma) (mi)y» (m 2 )]] 



1/2 



J 



.])] + 



\ 



/ 



1/2 



< 2 



1/2 



/ (2**1 - l)Tr [Ej / n[(E x n[IT 1 .^])(E a; n[ /9 ^ J/ „])]] + 

(2* - l)Tr (E x n[(E v „[n a! ^])(E tf n[^„ 1/ n])]] + 

(2^1 - 1)(2"*2 - 1)TT [(E x n ?/ „[n ;c „j / n])(E 3; n y n[ /3 ^ 3/ ,. 
2"" Rl • E x n y ii[TV [ITaj^y^Pyn]] + 2™^ 2 • E^n^Tr [Il^nynp^n]] + 

2 n(i?. 1+ R 2 ) . E^nfTr [ft^nynp']] + 1 - E [TV [fi^//^ ]] 

The second inequality follows from concavity of square root. The equality follows from the inde- 
pendent and identical choice of codewords for a pair of different messages. 

( xv) n 

We now bound the terms on the right hand side above. If x n y n £1] , then 

Tr [fl x n y n p' yn ] < (1 — yfe) lr Tl [Ily" Il^ny n Uy n p' y n ] 



< 2< H ^ XY )^\\ - y^Tr [U y n Pxnyn U yn p' yn ] 



x' L y" 



and 



where we use the definition of H x n y n^ Lemma [Hand Fact El If x n y n (£Tf 1 , thenn 
the upper bound on the trace above holds trivially. Fix y n £ TY . We get 

E x n [Tr [fl x n yn p' yn ]} < 2 n ^ B \ XY ^ +c{ ^\l - ^) _1 E x .n[Tr [U y n p x „ yn U yn p' y n\] 

= 2 n(H(B\XY) p+ c(S)) {1 _ ^-1^ [Uyti (E x n [p x n y n])Il y n p' yn ] 

= 2< H W XY ^+< S )){1 - ^y l Tr [U yn p yn n ynp ' yn ] 

< 2 -n(H(B\Y) p -c m) . 2 n(H(B\XY) + c(S)) {1 _ ^-1^ [Ii yn p' yn ) 

< 2 -n(/(X:B|y) p -2c(6«))( 1 _ 

,™ / v"y"\n ~ 

where we use FactO If y n T/ , then for all x n e X n , x n y n Tf 1 ' and n 

x n y n 

= 0, so the above 

upper bound on E x n[Tr [n^"^/^*^] holds trivially. We can now understand better the reason why 
the projectors tl x n y n are used in the decoding process instead of the conditionally typical projectors 

i X Y\ n 

U x n y n one may naively expect. Suppose x n y n £T5 . If we had used just Tl x n y n : we would not 
have been able to surround it by the projectors Ii y n in the above chain of inequalities and we 
would not have been able to prove the desired exponentially small upper bound. If we had used 
the positive operator Tl y Tl x n y nTl y instead, we would not have been able to apply Lemma [3] which 
is fundamental to our decoding strategy, since in general LT^ does not commute with H x n y n and 
hence U y IL x n y nIl y is not a projector. The operator H x « y n mimics the intuitive notion of projecting 
onto the intersection of the typical spaces of p x n yn and p y n in the commutative (classical) case. It 
is a bonafide orthogonal projector and smaller (up to an error factor of 1 — y/e) than the operator 
U y nTl x n y nTl y n . Hence it can be fruitfully used in our decoding strategy and its error analysis, and 
we can prove our desired exponentially small upper bound on the error probability. 



Continuing we get, for x n y n 6 T. 



(XY) n 



Tr [Il^^p^] < 



Px n 



■ TV [fl x n y n] < 4 • 2 -«W B l x )p- c ( 65 ))Tr [IV 



< 4 . 2 -n{H(B\X) p -c(66)) . 2 n(H(B\XY) p +c(8)) < 4 . 2 -n(I(Y:B\X) p -2c(68)) 
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where we use Lemma[H Fact[3]and the facts that rank^n^n) < rank(II x .n y n) and p' x n < Wp'^W^ 1- 

( YV) n - 

If x n y n ^Tf 1 ' , then n 

x n y n 

= and the upper bound on the trace above holds trivially. 
Similarly, for x n y n G Tg we have 

Tr [U x n y np'] < Wp'W^ ■ Tr [U x n y n] < 4 • 2 -< H ^- C ^ ■ Tr [U x n y n] 

< 4 . 2 -n{ff(B) P -c(M)) . gn^BIXy)^) < A . 2 - n ( I (XY:B) p -2c(2S)) ^ 

where we use Lemma[H Fact[3]and the facts that rank(n x n y n) < rank(n a; n y n) and p' < 1 1 1 1 ^ 1. If 
x n y n $ Tg , then Tl x n y n = and the upper bound on the trace above holds trivially. 
Finally, for x n y n 6 T 5 (Xr) ", 

Tr \Yl x n y np x n yn ] 

> Tr {Yl x n, y n,Tl x n, y n, p x n y nll x n,yn] — \\p x n y n — U x n, y n, p x n y n H x n y n \ \ j — \\p x n y n ~ P x n y n 1 1 j 

> (1 - 4>/i) - 2e - > 1 - 17ye, 

where we used Lemma [H Fact [3] and the fact that H x n y n commutes with p x n y n . For the second 
inequality we also used Lemma 0] to conclude that Tr \n. x n y n,(ll x n y np x n y nll x nyn)] > 1 — 4-\/e, since 

Tr [U y n (n 

x n y n Px n y n ^-x n y n )] ^ Tr [n^np^n^nj ||Pa; n 2/ n n y n Px n y' n ^x n y n \ \ \ 

> 1 - e - 2e = 1 - 3e, 

where we used Facts [H [3] and the fact that Tl x n y n commutes with p x n y n . We proceed to get 

B x n y n[TT [U x n y np' xnyn ]} > (1 - C )(l - 17^) > 1 - 18yft, 

using Fact [TJ 

Putting all this together, we get 

E [err(mi, 7712)] 



< 2 • 



2 nR ± . 2-n(I(X:B\Y) p -2c(68)) ?i _ + 4 . 2 ni?2 . 2-™(^ :B l x )p-2c(65)) 

+ 4 . 2 n(«i+«2) . 2-n{.I(XY:B) p -2cQSS)) + lgy ^ 



Choosing rate pairs satisfying the inequalities 

Ri < I{X : B\Y) P - 4c(6<5), R 2 < I(Y : B\X) p - 4c(6S),Ri + R 2 < I{XY : B) p - 4c(6<5), (5) 

and using the fact that e < 1/64 gives us E [err (mi , m 2 )] < lOe 1 / 4 + 8 • 2' nc ^ , for which if we take 
n = Clog(l/e)5~ 2 for a constant C depending only on the state p XYB , we get E [err(mi, m.2)] < 

10 e !/4 + 8 . 2 -C5- 2 C (65)log(l/e)_ 

Since we have shown that E [err (mi, 771-2)] is small for all message pairs (mi,ro2), the expected 
average error probability E [effgv] := E [2~™(- Rl +- R2 ) ^ err g;/ (mi, mj)] for channel £' is also 
small. We can now apply an argument similar to that of the proof of Theorem [T] to show that the 
expected average error probability is also small for n copies of the original channel £ for the same 
encoding and decoding procedures as described in Figures [3] and HI Doing so allows us to show that 

E [erf £ ] < E [erf?] + 13v^ < 23e 1/4 + 8 • 2~ cs ' 2c ^ 1 °s( 1 A) > 

where C is the same constant as above, depending only on the channel £. This quantity can be 
made arbitrarily small by choosing e and S appropriately. We can also simultaneously make c(6S) 
arbitrarily small so that the rate pair (Ri, R2) approaches the boundary of the region described in 
Equation [H We have thus shown the following theorem. 
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Theorem 2. For a two sender multiple access channel £ with classical input and quantum output, 
the random encoding and sequential decoding strategies described in Figures and \4\ c o- n achieve 
any rate in the region described by Equation [7] with arbitrary small expected average probability of 
error in the asymptotic limit of many independent uses of the channel. 

A pretty good measurement decoder: We can construct a jointly typical decoder for the ccq- 
MAC using the pretty good measurement with positive operators n 2/ n( m2 )II ;i .n( mi ) 2/ n( m2 )II 3/ n( m2 ). We 
analyse the decoding error as above, imagining that the channel we are working with is a single 
copy of €■' and then concluding that the decoding error for n copies of the original channel <£ is 
small. The same decoding strategy was independently discovered by Fawzi et al. [SFW + li] . and 
by Xu and Wilde |XW11] for the entanglement assisted case. 

4.2 Extension to MACs with three or more senders? 

We have constructed a jointly typical decoder for a two-sender MAC. A natural question that arises 
is whether we can get jointly typical decoders for MACs with three or more senders. However, our 
method runs into problems with three senders. Observe that our bounds on R2 and R\ + R2 used 
that H/O^nlloo and H/n'll^ are small, whereas our bound on R\ came from the property that tl x n y n 
is roughly less than H y nIl x n y nYi y n . For a three sender MAC we can, for example, get bounds on 
R\ and R\ + Ri by constructing, using Lemma H] twice, an orthogonal projection U x n y n z n such 
that it is roughly less than U z nYl y n z nIl 

X n y n Z n H z n. We can also get the desired bound on R2, 

R2 + R3 and R\ + R2 + R3 by doing asymptotic smoothing using Lemma Q] which gives us a state 
piX n Y n z n B n c i ose pX n Y n z n B n guch that \\p' xnzU jj^, Hp^lloo an< ^ 1 1/ 9 ' I loo are smau - However now 
if we want to get the desired bound on i?3 we would need || to be small too. We do not 

know how to prove the existence of such states p' xnY " z " B _ The asymptotic smoothing methods 
of Section 12.21 seem to fail to show this. 

If we assume that some suitable averaged output states commute, then we can construct a jointly 
typical decoder for the three sender MAC. For example, suppose that for all x, y, z, p yz commutes 
with p xy for the same value of y, and also p y commutes with p z . Then we can choose TL x n y n z n 
such that it is roughly less than H z nTlyn z nTl x nyn z nTlyn z nIl z n as well as Tl y nTl x n y nTl x nyn z nT[ x nynTlyn 
by using Lemma |4] twice with the intersections of supports of H x n y n and Hyn e n, and H y n and H z n. 
This allows us to get the desired bounds on R\, R\ + R2, R3 and R± + R3. The desired bounds on 
R2, R2 + R3 and R\-\- R2 + R3 can be obtained using asymptotic smoothing as before. 

Note that we can easily do successive cancellation by our sequential decoding method and ap- 
proach any vertex point of the rate region of a MAC with any number of senders. For example, 
to approach the vertex point (I(X : B),I(Y : B\X),I(Z : B\XY)) of the rate region of a three- 
sender MAC, we do successive cancellation using the decoding method for a cq-channel described 
in Section [3] earlier as follows. Let the transmitted messages be mi, TO2, m% where mi G 2 nRi , 
R x < I(X : B), R 2 < I{Y : B\X), R 3 < I{Z : B\XY). First decode i"(mi) by applying a 
sequence of projectors EL,.^, i = 1, . . . , mi, then decode y n (m,2) by applying a sequence of pro- 
jectors H x -n( mx \yn(j\, j = 1, . . . ,m2 and finally decode z n {m^) by applying a sequence of projectors 
H-x n (m 1 )y n (m2)z n (k)i k = 1, . . . ,m^. Time sharing then gives us any point in the interior of the rate 
region. However for several applications, including the application to the interference channel, time 
sharing is not good enough and we seem to require a jointly typical decoder that can achieve any 
point in the interior of the rate region without time sharing and rate splitting. 
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In Section 14.31 we show that we can nevertheless get an inner bound with a jointly typical 
sequential decoder for a restricted MAC with three senders that we call the Chong-Motani-Garg 
MAC. Our inner bound is larger than the inner bound proved earlier by Chong, Motani and Garg. 
However, it does not lead to a larger inner bound for the interference channel as we will explain 
later in more detail in Section 

4.3 The Chong-Motani-Garg three-sender MAC 

As a warm-up for the Chong-Motani-Garg three-sender MAC, we first study a two-sender MAC 
where the receiver only cares to decode correctly the message of the first sender. The senders 
are forced to use the random encoding strategy of Figure [TJ We shall call such a MAC as the 
disinterested 2-MAC. Classically, Costa and El Gamal |CG87| considered a disinterested 2-MAC 
in their work on the interference channel with strong interference. They gave the following inner 
bound for the disinterested 2-MAC. 

Ri < I(X : B\Y), R 1 + R 2 <I(XY : B). 

Let mi and mi be the messages of senders 1 and 2 respectively. The receiver is only interested in 
recovering m\ correctly. Costa and El Gamal modelled this indifference towards by requiring 
the received word to be jointly typical with a pair mi,m 2 where only mi has to be unique. In 
other words, the decoder checks if the received word lies in the union, over all 777-2, of sets of output 
words typical with (mi, m 2 ) for a given m\. If there is exactly one such message mi, the receiver 
declares it to be her guess for the message sent by sender 1, or else she declares error. This allowed 
them to 'forget' the constraint on R 2 that would normally be there in the inner bound Equation [J] 
for a standard 2-MAC. 

In the quantum case, a naive analogue would be to loop over all messages mi and for a fixed 
mi, to try and project the received state onto the span, over all 777-2, of the conditionally typical 
subspaces of the pairs (mi, 777,2). If the attempt were to succeed for a given message mi, the receiver 
would declare it to be her guess for the message sent by sender 1. However, it seems difficult to 
prove good upper bounds on the decoding error probability for this naive quantum strategy. The 
main problem with this strategy is that in general the projector onto the span of a set of subspaces 
is not upper bounded well by the sum of the projectors onto the individual subspaces, if those 
projectors do not commute. This problem does not arise in the classsical case. Nevertheless, we 
can sidestep this problem by using a different decoding strategy which will let us easily prove the 
following inner bound for the disinterested 2-MAC. 

I(X : B) p <Ri< I(X : B\Y) p , Ri + R 2 < I(XY : B) p , 

OR (6) 
Ri < I(X : B) p . 

Above, 

p XYB ig 

the joint state of the system XYB defined in Equation [3l The above (quantum) 
inner bound is larger than Costa and El Gamal's inner bound. Our decoder is a jointly typical 
decoder doing a sequence of orthogonal projections. In order to achieve a rate pair (R\, R 2 ) where 
Ri < I(X : B) p , the decoder just adopts the sequential decoding procedure of Figure [2j In order 
to achieve a rate pair (Ri, R 2 ) where I(X : B) p < R% < I(X : B\Y) p , the decoder just adopts the 
sequential decoding procedure of Figure HI This works because now R 2 < I(Y : B\X). Note that 
the above inner bound forms a non-convex set. 
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We now describe the Chong-Motani-Garg three-sender MAC, called CMG-MAC for short. Let 
£ : (z, y) h-> p zy be a channel that takes two classical inputs z and y and outputs a quantum state 
p zy . Let X, Z, Y be classical random variables such that Y is independent of XZ. We define 

p xzYB ._ J2 p x {x)p z \x{z\x)p Y {y)\x,z,y){x,z,y\ ® p zy (7) 

(x,z,y)eXxZxy 

to denote the joint state of the system XZYB. 

In the CMG-MAC there are three senders and one receiver. Suppose senders 1, 2, 3 want to 
transmit at rates R\, R2, R3 using n independent uses of the channel <£. Let their messages be 
denoted by mi, mi-, VH3, where 1 < mi < 2 nRi . The senders are forced to use the random encoding 
strategy of Figure [5] to choose a codebook C. Note that the encoding strategies of senders 1 and 2 
are not independent in general. 

Encoding strategy to create a codebook C 



Sender 1: For m\ = 1 to 2 1 , choose x n {m\) ~ X n independently. 
Sender 2: For 7772 = 1 to 2 nR2 , choose z n (mi,m2) ~ Z n \x n (m\) independently. 
Sender 3: For 7773 = 1 to 2 nRi , choose y n {m3) ~ Y n independently. 



Figure 5: Encoding strategy for CMG-MAC. 

The receiver is only interested in recovering the message pair (777-1,7712) correctly. As in our 
inner bound for the disinterested 2-MAC in Equation [61 we sidestep the problem of 'forgetting' a 
constraint in the quantum setting by adopting one of two different decoding strategies depending 
upon where our rate triple (Ri, R2, R3) lies. Our decoder is a jointly typical decoder doing a 
sequence of orthogonal projections. The inner bound that we end up proving via this two pronged 
decoding strategy is larger than the inner bound proved earlier in the classical setting by Chong, 
Motani and Garg. Note that our inner bound is not convex. 

R 3 < I(Y : B\Z) P , R 2 < I(Z : B\XY) p , R l + R 2 < I(Z : B\Y) p , 
R 2 + R 3 <I{ZY :B\X) p , R x + R 2 + R 3 < I(ZY : B) p , 

OR (8) 
R 3 > I(Y : B\Z) p , R 2 < I(Z : B\X) p , i?i + R 2 < I{Z : B) p . 

Recall that Chong, Motani and Garg's inner bound is 

R 2 < I(Z : B\XY), R l +R 2 <I{Z : B\Y), R 2 + R 3 < I(ZY : B\X), R1+R2 + R3 < I(ZY : B). 

Our inner bound contains their inner bound because taking R3 > I(Y : B\Z) in their inner bound 
implies the inequalities R2 < I(Z : B\X) and R\ + R2 < I(Z : B). 
Define the following averaged density matrices: 

Pz ■= T,yeyPY(y)pzyi Pxy ■= Y.zezPz\x(z\x)Pzy, Px ■= Y.zezPz\x(z\x)pz = Y.yeyPY(y)Pxy 

Py ■= EzezPz(z)pzy, P ■= EyeyMl/W 
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We can now define the n-fold tensor product matrices Pz n y n , Px n y n , Pz", Px 11 , Py n for sequences x n , 
z n , y n in the natural manner. Note that from the definition of p XZYB in Equation [71 H(B\ZY) = 
H(B\ZXY),H(B\Z) = H(B\XZ). 
Let < e,6 < 1/64. Define 



Pi- 



mm pxz(x, z)py (y), 

(x,z,y)£X xZxy, Pxz (x,z)p Y (y)>0 



mm q mm 

(x,z,y)&XxZxy,p xz (x,z)p Y {y)>Q 



(Pz,y)- 



Let n > 45- 2 p n ^q m l n \og(\B\\X\\Z\\y\/£)- Define c(<5) := <Slog |£||*||Z 



5 log 5. Suppose that 



x n z n y n £ y 



(XZYf 



. Let H z n y n, H x n yn , U y n denote the conditionally typical projectors IL 



n 65 i 



II 6 |" . We define a projector U x n z n yn as follows. Treat the supports of the conditionally 



typical projectors n z n y n, TL x n y n as the subspaces A', B' of Lemma HI and obtain U' x n z n y n as the 
projector IL3 promised by Lemma [H Now treat the supports of H' x n z n y n and I\. y n as the subspaces 
A', B' of Lemma HI and obtain U x n z n y n as the projector n# promised by Lemma [H If x n z n y n ^ 
T^ XZY)n , define U x n z n y n := 0. Then for all x n z n y n , 



< (i - ^-^nni n n 



Ilyn 



The decoding procedure shall use the projectors H x n z n y n. 

Depending upon whether the desired rate triple (R\, R2, R3) falls into the first or the second 
region in Equation [81 the receiver adopts one of two sequential decoding strategies. As will become 
clear later, the ordering of messages is not very important but we impose the lexicographic ordering 
looping over 7713 first, then 7712 and then mi, while describing the decoding algorithms, for clarity 
of exposition. 

We now describe the receiver's decoding strategy when the rate triple falls into the first region. 
Given the codebook C, the receiver uses the sequential decoding strategy of Figure [6j 

In order to analyse the success probability of decoding a message correctly, we first imagine that 
we are given a slightly different channel £' working on alphabets X n , Z n , y n with output Hilbert 
space B® n . It is defined as €.' : (x n , z n ,y n ) h-> p' x n z n yn where the states {p'x^z n y n }(x n ,z n ,y n )eX n xZ n xy n 
are as provided by Lemma [T] given state p XZYB . Let p' x z Y " Bn De as defined by Lemma [H The 
encoding and decoding strategies used continue to be exactly as in Figures [5] and [6l even though 
the channel we are now working with is a single copy of 

We shall use the notation (x n , z n , y n )(mi, m%, 7773) to denote (x n (mi), z n (mi, 7712), y n {rn^)). We 
shall use the symbol E [•] to denote expectation over the choice of the random codebook C. 
We shall also use notation like E x n z n y n [p' x n z n y n] := J2 x n ,z n ,y n P(xz) n ( xnzn )PY n (y n )p' x n z n y n, and 



E z n \x n [p'x n z n y n ] := Pz n \x n ( zn \ xn )p'x n z n y n - Arguing as in Section |4~T1 we see that the expected 
error probability E [err(mi, 7772, WI3)] of decoding (1711,7712,7713) is at most 



E [err (mi, 7772, 7773)] 

1 £ 



< 2-E 



(i,j,k)^(m 1 ,m2,m 3 ) 



V 



Tr ^{x n ,z n ,y n ){i,j,k)P[x n ,z n ,y n ){mx,m2,rni)\ + 1 ^ 



1/2 
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Decoding strategy for codebook C for first region 



Received some state t b " at the channel output; 

For mi = 1 to 2 nRl , 

For m 2 = 1 to 2 nife , 
For m 3 = 1 to 2 nR * , 

Repeat the following till first success; 

- Let 

Tm\m-zm-& be the state at the beginning of loop number 
(m 1 ,m 2) m 3 ); 

- Project T mim2m:j onto H-x n {mx),z n (mi,m.2),y n {m3)- Iffau proceed, else 
declare success and announce (roi,m2, 1713) to be the guess for the 
messages sent by senders 1, 2 and 3. 

If all candidate message triples are exhausted without success, abort. 



Figure 6: Decoding strategy for CMG-MAC for first region. 



< 2- 



^ Tr t E ^(x n ,^,y n )(iJ,rn3)P(x n ,z n ,y n )(mi,m2,m 3 )\] + \ 



1/2 



^1 Tr [E [n( x n jZ n jy n)( mi J 7 k)P[. 



x n ,z n ,y n )(mi ,m2,m3)J 



+ 



Tr t E [n(a;»,«™,i/«)(i,i,fc)/ ? (a;i,2!«,j/™)(mi,m2,m3)]] + 



y 1 E [TV [II(a! r »,«",i/")(mi,m2,m3)P(a!" ) z",i/")(mi,m2,m3)]] / 

2"(Hl+i?2) . J] x n z n y n [Tr [H-x n Z n y n Py™]] + 2"^ 2 • E x n z n y n [TV [tlx™ Z n y n P x n y n ]] + 

< 2 • I 2 n ^ 3 • E ^n^n^n [Tr \Ylx n z n y n P x n z n ]] + 2 n ^ 2+ ^ 3 ^ • E x n z n y n [Tr {n- x ™ z n y n Px n }] + 

2".(i?l+i? 2 +fl3) . E 3; n 2 n J/ n [TV [Il^n 2 "l;™ P'] ] + 1 — E x n Z n y n [Tr [^"z"!,"^"^^]] 



1/2 



The second inequality follows from concavity of square root. The third inequality follows from 
the independent and identical choice of codewords for a pair of different messages and from the 
encoding strategy used. 

We now bound the terms on the right hand side above. Arguing as in Section 14. 1\ we see that 
for any y n G Tj , 

E x n^"[Tr [Iljn^jn^]] 

^ (i — v^) ^e x n z n [Tr [n^rc n^y^n^^na^^ri^Pyri]] 



25 



< 


2n(H(B\ZY) p +c{8) 


>(l-« 


& 


2 E a;" 2 n [Tr [LTyn H x n y n p z n y n U x n y n U y n p' y „ ] ] 




2n(H(B\ZY) p +c(S) 


>(l-« 




^E [Tr [Ily™ TJ. x n y n (E 2 n \p z n y n ] )rix n y n Ll^Ti 




2n(H(B\ZY) p +c(S) 


>(!-« 




2 Ej» [Tr [Ilyn H x n y n Px n y" Tl x n y n H y n p' y „]] 


< 


2n{H(B\ZY) p +c(S) 


>(!-« 


& 


2 Ei™[Tr [n y n/9a;n y nnynp^ n ]] 




2n(H(B\ZY) p +c(5) 


>(!-« 


/3 


2 Tr [H y n p y nll y n p' yn ] 



< 2 -n(ff(fl|y)p-c(6«)) . 2 n(H(B|zy) +c («5)) (1 _ ^)-2 Tr [IIjB ^] 

< 2 -»(/(Z:B|y) p -2c(6«)) ^-2 < 2 . 2 ~n(I(Z:B\Y) p -2c(68)) _ 

The above upper bound holds trivially if y n g" . 
Similarly, for any x n y n E [H^ , 

E 2 «|a;n[Tr [Ilx™2' 1 ?/ rl Px™?/"]] 

< (1 — y/e) 2 E z n\ x n[Tr [Tl y nll x ri y rill z n y rill xnyn ll yn p' xnyn ]] 

< 2 n(H ^ ZY ^ +C ^(l - ^€)- 2 B^[Fr [U y nU x n y np z n y nU x n y nU y np' xnyn ]] 
= 2 n ^ ZY ^ +C ^(l - Vey 2 Tr [Il y nU x n y n p xny n U x n y np' xnyn ] 

< 2 -n(H(B\XY) p -c m . 2 nmB\ZY)+cm {l _ ^-2-^ [ Uy nU x n yn U yn p' xnyn ] 

< 2 -n(H(B|Xy) p -c(65)) . 2 n(H(B|ZXy)+c(*))n _ ^-2 

< 2 , 2 -n(/(Z:B|XY) p -2c(6<5)) 

The above upper bound holds trivially if x n y n T$ 
Next, we see that for any x n z n y n G Af™ x x 3^ n , 

Tr [fl x n z n y np x n z n] < \\p' x n z n\\ ^ ■ Tr [II x n z n y n] 

< 4 . 2 -n(H(B|XZ) p -c(6<5)) _ 2 n(H(B|Zy) p +c(<5)) 

= 4 . 2 -n(H(B|2) p -c(6<5)) . 2 n(H(B|ZY) p +c(<5)) < 4 . 2 -n(/(Y :B\Z) p -2c(6S)) 



where we use Lemma [Tj 

Similarly, for any x n z n y n G X n x Z n x y n , 

Tr [Il x n z n y np x n] < \\ p' x n\\ ^ ' Tr [Ii x n z n y n] 

< 4 . 2 -n(//(B|X) p -c(6<5)) _ 2n(H{B\ZY) p +c(8)) 

= 4 . 2 " n ( H ( B l X )p- c ( 6<5 )) • 2 nW£|ZXY) p +c(<5)) = 4 . 2 -n(/(YZ:B|X) p -2c(6(5)) 

Again, for any x n z n y n G A" 1 x 2™ x J'™, 

Tr [fLj^n^n//] < Hp'II^ • Tr [IT 2: n 2 n J/ n] 

< 4 . 2 -n(H(B) p -c(2(J)) . 2 n(H(B|Zy) p +c(<5)) = 4 . 2 -n(/(YZ:.B) p -2c(2<5)) _ 

Finally, for x n z n y n G r 5 (XZy) ", 

Tr \^- x n z n y nP x n z n y n\ 

> Tr [Il xn z „ y nTl z n y np z n yn T[ z n y n] — \\p z n y n — U z n y n p z n y n Tl z n y n 1 1 ^ — \\p z n y n — P x n z n y n 1 1 , 

> Tr \tl[ £ n z n y nTl. z n y n p z n y nT\ z n y n^ — 2g — ll"y/e > TV \Tl x n z n y nTl z ri y n p z ii y nYl z n y n^ — 13\/e, 
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where we used Lemma [H Fact [3] and the fact that H z n y n commutes with p z n y n. Since 

> l-e-2e = l-3e, 

where we used Facts [H [3] and the fact that U z n y n commutes with p z n y n , we see that 

Tr \n. f x n z nyn(Ti z nyn p z nynYl z nyn^ > 1 — 4\/i, 

by Lemma [H Hence, Tr [IT,, 

71 z ri y n I X n z n y n 

] > 1 - 17 Ve. Now 



Tr [Il^n (]J x „ z „y n p xnz ny-nIl x n z nyri)] 



^ Tr [Ily T1 P Z n y n ] 



Px 



n z nyn 



H x n z riynp x n z nyn H x n z n y n 



\p z n y n — p x n z n yn 



> l-e-10e 1/4 -ll^ > l-22e 1/4 , 
where we used Lemma Q] and Facts [3j [5j By Lemma HI 



Tr \n x nyn z n(f[' x n z n y rip' x n z riynf[' x n z riyn)) > 1 — lOe^ 



which implies 



Tr [U x nyn z u p x „ z „y n ] 

— Tr [ILc n y n j2 n ^II^,n z n y n Px n Z n y n ^~^~X n Z n y r> 

> 1 - 10e 1/s - 10e 1/4 > 1 - 20e 1/8 . 



P x n y n 



frf I fV/ 

-Ll^n z riyn P x n z ^yn LL x n z riyn 



We proceed to get 

E^n^fTr [fl x n z n y np' xnznyn ]] > (1 - e ) (1 - 20e 1/4 ) > 1 - 21e 1/s , 

using Fact [TJ 

Putting all this together, we get 

E [err(mi, m-2, 7713)] 

(2n(Ri+R 2 ) . 2 . 2- n (HZ--B\Y) p -2c(6S)) + 2 ni? 2 . 2 . 2- n ( 7 ( Z:B l xy )p- 2c ( 65 )) + 
2^3 . 4 . 2-"(i'(^:-B|Z)„-2c(65)) + 2 n (R2+Rs) . 4 . 2-"(i"(^^S|X) p -2c(6<5)) + 
2 n(R 1 +R 2 +R 3 ) . 4 . 2 -n(I(YZ:B) p - 2 c(68)) + 2 l e V8 

Choosing rate triples satisfying the inequalities 

Ri + R 2 < I(Z : B|y) p - 4e(6<5), R 2 < I(Z : - 4c(6<5), i? 3 < J(F : B\Z) P - 4c(65), 

R 2 + R 3 < I(YZ : J3|X) p - 4c(6<J), Ri + R 2 + R 3 < I{YZ : £)„ - 4c(6<5), 



1/2 



(9) 



gives us E[err(mi,m 2 ,m 3 )] < lOe 1 / 16 + 8 • 2~ nc ( 65 ), for which if we take n = Clog(l/e)J 2 for a 
constant C depending only on the state p XZYB , we get 



E [err(mi, 7712)] < E [err(mi, m 2 , m^)] < lOe 1 / 16 + 8 • 2~ 



-C8- 2 c(68) log(l/e) 
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Decoding strategy for codebook C for second region 



Received some state t b " at the channel output; 

For mi = 1 to 2 nRl , 

For m 2 = 1 to 2 nR2 , 

Repeat the following till first success; 

— Let T mini2 be the state at the beginning of loop number (mi, m 2 ); 

— Project r mim2 onto il( x * z n )(mi,ma)- ^ ^ au proceed, else declare 
success and announce (mi, 7712) to be the guess for the messages 
sent by senders 1 and 2. 

If all candidate message triples are exhausted without success, abort. 



Figure 7: Decoding strategy for CMG-MAC for second region. 



We now describe the receiver's decoding strategy when the rate triple falls into the second 
~ n ( x y) n ~ 

region. Define Ii x n z n '■= 

n 2 n := Il£* n if x n z n G Tf"> , and II x n 2 n := otherwise. The receiver 
uses the sequential decoding strategy of Figure El 

Again, we analyse the decoding error probability for the modified channel £' first. Arguing as 
in Section [4.11 we see that the expected error probability E [err(mi, 777-2)] of decoding (777.1,7712) is 
now at most 



E [err(mi, m 2 )] 

/ E 



< 2 • E 



< 2 • 



< 2 • 



Tr [K(x n ,z n )(i,j)P{x™,z n ,y n )(mi,m2,m 3 )] + 

(*>jMM;¥( m i> m 2) 
\ 1 — Tr [H(x n ,z n )(mi,m2)P(x n ,z n ,y n )(mi,m!2,m3)' 

\ 1/2 



1/2 



,m2,m3)i 



+ 



/I Tr I E [^-(x",z n )(m 1 ,j)P{x^,z",y n )(m 1 ,m 2 ,rn 3 )]\ + 



j:j^rn 2 



y l-E[Tr \K(x n ,z n )(m 1 ,m2)P( x n )Z 'i >y n)( mi> m 2 ,m 3 )\'\ J 

2 n{R 1+ R 2 ) . E x n z n [Tr [fl x n z np']\ + 2 nR * • E x n z n [Tr [W/)^]] + N ' " 



1 — E^^ffi [n^nj-np^n^]] 

For any (x",z n ) G Af n x Z n , 

Tr [fi^n^p'j < Hp'II^ • Tr [fW] < 2 -™W B )p- c ( 25 ) . ^{H{B\Z)„+c(S)) < 4 • 2 -™('(^) P - 2c (2^ 
Also, for any (x n , z n ) E X n x Z n , 

Tr[IWp£,»] < |K« II -Tr[IW] < 4 . 2 -"WB|X) p - C (65)) . 2 n(H(B|Z) p+ c(5)) 



4-2 



-Ti(/r(B[X) p -c(6(5)) . 9 n(/i(B|ZX) p +c(<5)) 



4-2 



-n(/(Z:B|X) p -2c(6<5)) 
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Finally, for x n z n £ T^ XZ) ", 
Tr \n x n zn p' x „ zn ] 

> Tr [n^np^n] — \\p z n — /^r^n]^ > Tr [Iljnp^n] — E y n [ 1 1 p z n y n — /O^n ^n^n |L ] 

> 1 - e - llVe > 1 - 12ye, 
where we used Lemma [TJ Using Fact [TJ we get 

E x n z „[Tr [fL x n z np' xnzn }] > (1 -e)(l - 12^/i) > 1 - 13>/i. 
Putting it together, we get 
E [err (mi, 777.2)] 

< 2 . C 2 n(Hi+iJ 2 ) . 4 . 2 -n.(/(Z:B) p -2 C (65)) + 2 nH 2 . 4 . 2 -n(/(Z:B|X) p -2 C (65)) + 1/2 



Choosing rate triples satisfying the inequalities 

Ri + R 2 <I(Z :B) p -4c(6S), R 2 <I(Z:B\X) p -4c(65), (10) 

gives us E [err (mi, 777,2)] < Se 1 / 4 + 8 • 2~ nc ^ s \ for which if we take n = C log(l/e)J -2 for a constant 
C depending only on the state p XZYB , we get 



E [err(mi, m 2 )] < 8e 1/4 + 8-2" 



C5- 2 c(68) log(l/e) 



Note that in the second decoding strategy, the rate R3 plays no role. However, if i?3 < I(Y : 
B\Z) p , the rate triple falls into region 1. Hence, we impose the condition i?3 > IiY : B\Z) p while 
describing region 2. 

Since we have shown that E [err(mi, 7712)] is small for all message pairs (mi, 7772) for both region 1 
and 2, the expected average error probability E [effgy] := E [2 _n '(- Rl +- R2 ) £^ m ^ errg/(mi, 777-2)] for 
channel C is also small. We can now apply an argument similar to that of the proof of Theorem [JJ 
to show that the expected average error probability is also small for 77 copies of the original channel 
£ for the same encoding and decoding procedures as described in Figures [5j [6j [TJ Doing so allows 
us to show that 

E [effc] < E [effey] + 13^ < 23e 1/16 + 8 • 2 - cs ~ 2c ^ lo ^ £ \ 

where C is the same constant as above, depending only on the channel C This quantity can be 
made arbitrarily small by choosing e and 5 appropriately. We can also simultaneously make c(6<5) 
arbitrarily small so that the rate pair (R±, R2) approaches the boundary of the region described in 
Equation O We have thus shown the following theorem. 

Theorem 3. For the CMG-MAC with classical input and quantum output, the random encoding 
and sequential decoding strategies described in Figures^, and Figures^ and\7\ can achieve any rate 
in the region described by Equation with arbitrary small expected average probability of error in 
the asymptotic limit of many independent uses of the channel. 
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A pretty good measurement decoder: Region 1 of our inner bound for the CMG-MAC can 
also be achieved by using the pretty good measurement with positive operators 

for typical x n {mi)z n {rni,rn2)y n {m^) and operator for atypical x n {mi)z n {mi,m2)y n {rn^). Re- 
gion 2 of our inner bound for the CMG-MAC can also be achieved by using the pretty good 
measurement with positive operators n z n( mi m2 ) for typical x n {m\)z n {yn\,rn2) and operator for 
atypical x n {m\)z n (mi,m2)- We analyse the decoding error as above, imagining that the channel 
we are working with is a single copy of £! and then concluding that the decoding error for n copies 
of the original channel £ is small. 



5 Sequential decoding for a two user interference channel 

The best known inner bound for a general two-sender two-receiver interference channel in the 
classical setting is the Han-Kobayashi rate region. To achieve a rate pair in this region requires one 
to construct a jointly typical decoder for a three sender MAC. Fawzi et al. jSFW + ll] showed that 
the same technique would extend to a two-sender two-receiver interference channel with classical 
inputs and quantum outputs (ccqq-IC), if we had a jointly typical decoder for a three-sender 
MAC with classical inputs and quantum output. They conjectured the existence of such a jointly 
typical decoder and proved it for a special case where some averaged output states commute. They 
also proved some other variants of the conjecture. However they left open the general case of 
the conjecture. In this work, we make some progress on the conjecture by proving it with reduced 
commutativity requirements, but we have not yet been able to prove the general case. Nevertheless, 
we have constructed a jointly typical decoder for the CMG-MAC in Section T4.31 Using this decoder, 
we prove the Chong-Motani-Garg inner bound for the ccqq-IC in this section. The Chong-Motani- 
Garg inner bound is known to be equivalent to the Han-Kobayashi inner bound under the addition of 
a time-sharing public random variable and going through all possible joint probability distributions 
of the time sharing variable and the input random variables [CMGG08J. 

Let (£ : (x, y) p x ,y be a ccqq-IC i.e. channel £ takes two classical inputs x, y and gives a 
quantum output p XjV in the Hilbert space B\ ® B 2 of the two receivers. Let X, Y be the input 
random variables of the channel. Like Chong, Motani and Garg, we introduce three additional 
random variables: a 'time-sharing' random variable Q which is public to all senders and receivers, 
and random variables U, V which represent the 'common' parts of messages of senders 1 and 2. 
In other words, we consider a joint probability distribution on QxUxXxVxy that factors 
as pQuxvY(q,u,x,v,y) = PQ(q)pux\Q{u,x\q)pVY\Q(v,y\q). Let the joint state of the system 
QUXVYB X B 2 be 

PQ(q)Pux\Q{u,x\q)p VY \ Q {v,y\q) 

(q,u,x,v,y)£QxUxXxVxy 

\q,u,x,v,y)(q,u,x,v,y\ Opf, 1 / 2 . 

Suppose senders 1 and 2 want to transmit to receivers 1 and 2 at rates R± and R 2 using n 
independent uses of the channel £. Sender 1 splits her rate R± into R\ c for the 'common' part 
and R\p for the 'personal' part. In other words, her messages come from the set 2 nRlc x 2 nRlp 
where R\ c + R\ p = R\. Let mi c , mi p denote the two parts of the message of sender 1. A similar 



QUXVYB 1 B 2 
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'rate-splitting' strategy is adopted by sender 2. Receiver 1 wants to decode the complete message 
of Sender 1, and for some rate points, also the common message of Sender 2. Receiver 2 also has 
a similar aim. The senders use the random encoding strategy of Figure [8] in order to transmit 
information over the channel (£. 

Encoding strategy to create a codebook C 



Choose q n ~ Q n . 

For mic = 1 to 2 nRlc , choose u n (mi c ) ~ U n \q n independently. 

For mip = 1 to 2 nRl p, choose x n {mi C} m\ p ) ~ X n \(q n , u n (mi c )) independently. 

Feed x n {mi Cl m\ p ) as input to the channel. 

For m2c = 1 to 2 nR2c , choose v n (rri2c) ~ V n \q n independently. 

For r7i2 P = 1 to 2 nR2p , choose y n (m2 C ,nii p ) ~ Y n \{q n , v n (m2 C )) independently. 

Feed y n (m2 C ,m2p) as input to the channel. 



Figure 8: Encoding strategy for the ccqq-IC. 

Fix a typical q n G Tg . Fix a symbol q £ Q. Consider the copies i of the channel <£ with 
q n {i) = q' ■ From the typicality of q 11 , the number of such copies satisfies N(q'\q n ) £ np(q)(l ± 8). 
For those copies, from the point of view of each receiver, the channel behaves as a CMG-MAC with 
joint state 

P UXVBi (q')-= ^2 Pux\q(%xW)Pv\q(vW)\u,x,v)(u,x,v\ <g> p^ v , 
(u,x,v)eUxXxV 

where p R ^ v := ^2 ye yPY\VQ(y\ v iQ')PxJy Using the decoding strategy of Section I3~3l receiver 1 can 
achieve any rate triple in the following region: 

R 2c (q') < I(V : Rip(q') < I{X : B^UV^q')^ R lc {q') + R lp (q') < I(X : B x \V,q') p , 

Rip(q') + R 2 cW) < I{XV : B x \U,q') p , R lc {q') + R lp {q') + R 2c {q') < I {XV : B^q')^ 

OR 

R2cW) > I(V : B^X^'),, R lp {q') < I(V : fli|CW)„ Ric(q') + Ri P (q') < I{X : B 1 \q J ) p . 

Running over all possible symbols q' £ q n and appealing to the typicality of q n , we see that receiver 1 
can decode with low error probability for any point in the following rate region: 

R 2c < I(V : Bi\XQ) p , R lp < I(X : B^UVQ),, R lc + R lp < I(X : B^\VQ) P , 
Rx p + R 2 c<I{XV:B 1 \UQ) lh R lc + R lp + R 2c <I(XV :B 1 \Q) p , 

OR 1 j 

R2c > I(V : B 1 \XQ) p , R lp < I(V : B 1 \UQ) p , R u + R lp < I(X : B x \Q) p . 

Since the decoding error probability of receiver 1 is small, an application of Fact [5] allows Receiver 2 
to pretend as if he is the sole receiver, and use the same CMG-MAC decoding strategy. Hence, he 



Public coin: 
Sender 1: 

Sender 2: 



31 



can decode with low error probability for any point in the following rate region: 

R lc < I(U : B 2 \YQ) p , R 2p < I(Y : B 2 \UVQ) P , R 2c + R 2p < I(Y : B 2 \UQ) p , 
R 2p + Ric<I(YU:B 2 \VQ) p , R 2c + R 2p + R lc < I(YU : B 2 \Q) P , 

OR 1 > 

Ric > I(U : B 2 \YQ) p , R 2p < I(U : B 2 \VQ) P , R 2c + R 2p < I(Y : B 2 \Q) p . 

We have thus shown that any rate quadruple (i?i c , R\ p , R 2c , R 2p ) satisfying the inequalities in 
inequalities [TT] and [12] above gives us an achievable rate pair (R\,R 2 ) for the ccqq-IC, where 
R\ = Ric + Rip and R 2 = R 2c + R 2p . 

Since our inner bound for the CMG-MAC is larger than the inner bound known previously in 
the classical setting, our inner bound for the interference channel is at least as large as the Chong- 
Motani-Garg inner bound. One may wonder whether our inner bound is actually larger. We now 
prove that in fact it is not so; for the interference channel we get exactly the same inner bound as 
Chong, Motani and Garg. We are grateful to Omar Fawzi |Fawll| for this observation and include 
it here with his permission. 

Consider a rate quadruple (R\ c , R\ p , R 2c , R 2p ) where (Ri c , Ri p , R 2c ) lies in the second part of 
the region in inequalities HU Recall that in this case Receiver 1 ignores the common message of 
Sender 2 and decodes the complete message of Sender 1 by using projectors depending only on 
the marginal distribution on UX. Consider now a different encoding strategy where the common 
message of Sender 2 is set to a fixed value, that is, V is now fixed, Y is distributed with the 
same marginal distribution as before and UX also have the same marginal distribution as before. 
Receiver 1 can decode with the same rate pair (i?i c , Ri p ) as before using the same strategy. Observe 
now that Receiver 2 can decode with the new rate pair (i?' lc , R' 2c , R' 2p ) = (Ric, 0, R 2c + R 2p ) since in 
the inequalities [T2| the constraints on R\ c , R' 2c + R' 2p and R' 2c + R' 2p + R' lc are unaffected by fixing V, 
and the constraints on R' 2p and R' 2p + Ri c become equal to those on R' 2c + R' 2p and R' 2c + R 2p + R' lc 
respectively after fixing V. Thus, the rates R\ = R± c + R± p and R 2 = R 2c + R 2p are unaltered by 
the new encoding and decoding strategy. In the new strategy the rate triple {R\ c , R\ p , 0) lies in 
the first part of the region defined by the inequalities [TT| whereas the rate triple (0, R 2c + R 2p , Ri c ) 
lies in the same part of the region defined by the inequalities [12] as before since R\ c is unaffected. 
We can repeat the argument with Receiver 2 allowing us to conclude that for any feasible rate 
quadruple (Ri c , Ri p , R 2c , R 2p ), there is a another feasible rate quadruple (R" c , R'{ p , R 2c , R 2p ) such 
that R'{ := R'[ c + R'{ p = R\ c + R\ p =: R\, R 2 := R 2c + R 2p = R 2c + R 2p =: R 2 , and (R'{ c , Ri p , R 2c ) 
and {R'lci R 2c , R 2p ) he in the first parts of the regions defined by inequalities [TT1 and [T2l respectively. 
Since the first parts of our regions are contained in the Chong-Motani-Garg region, we conclude 
that we get exactly the same inner bound for the interference channel as Chong, Motani and Garg. 
In fact, what we have actually shown is that the first parts of the regions defined by inequalities [TT1 
and 1121 suffice to get the Chong-Motani-Garg inner bound for the interference channel. 

6 Discussion and open problems 

In this paper, we have made several contributions to quantum Shannon theory. We have constructed 
a general paradigm for sequentially decoding channels with classical input and quantum output 
which directly mimics the classical intuition. We have applied this paradigm successfully to several 
channels culminating in a proof of the achievability of the Chong-Motani-Garg inner bound for 
the two user interference channel. In order to do this, we discovered a new kind of conditionally 
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typical projector that mimics the operation of intersection of two typical sets in classical information 
theory. 

Though we have proved the Chong-Motani-Garg inner bound for the ccqq-IC by first proving 
an inner bound for the CMG-MAC as in the classical approach of Chong, Motani and Garg, it 
is actually possible to obtain the Chong-Motani-Garg inner bound using just our simultaneous 
decoder for the ccq-MAC by combining it with geometric arguments from §a§oglu's paper §08 1. 
Details will appear in the full version of the paper. We followed the conventional route and proved 
our inner bound for the CMG-MAC in order to illustrate the reach and limitation of our current 
techniques. 

The main problem left open in this work is the existence of a simultaneous decoder for the 
multiple access channel with three or more senders. Such a decoder may pave the way for porting 
many results from classical network information theory to the quantum setting. 
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